From circular ordinal regression to multilabel classification
نویسندگان
چکیده
Several applications domains like wind forecasting in meteorology and robot control in robotics demand for learning algorithms that are able to make discrete directional predictions. We refer to this problem setting as circular ordinal regression, since it shares the same properties as traditional ordinal regression, namely the need for a specific model structure and order-preserving loss functions. This article gives a detailed introduction to the topic and proposes two methods. The first one is a circular support vector approach (cSVM), parameterized with only two vectors. The second method converts circular ordinal regression to a multilabel classification approach that takes the circular ranking into account by minimizing the Hamming loss. We also present initial empirical results based on two toy examples and a real-life application in the area of brain-computer interfaces.
منابع مشابه
Graded Multilabel Classification: The Ordinal Case
We propose a generalization of multilabel classification that we refer to as graded multilabel classification. The key idea is that, instead of requesting a yes-no answer to the question of class membership or, say, relevance of a class label for an instance, we allow for a graded membership of an instance, measured on an ordinal scale of membership degrees. This extension is motivated by pract...
متن کاملPredtron: A Family of Online Algorithms for General Prediction Problems
Modern prediction problems arising in multilabel learning and learning to rank pose unique challenges to the classical theory of supervised learning. These problems have large prediction and label spaces of a combinatorial nature and involve sophisticated loss functions. We offer a general framework to derive mistake driven online algorithms and associated loss bounds. The key ingredients in ou...
متن کاملMLSLR: Multilabel Learning via Sparse Logistic Regression
Multilabel learning, an emerging topic in machine learning, has received increasing attention in recent years. However, how to effectively tackle high-dimensional multilabel data, which are ubiquitous in real-world applications, is still an open issue in multilabel learning. Although many efforts have been made in variable selection for traditional data, little work concerns variable selection ...
متن کاملCombining Instance-Based Learning and Logistic Regression for Multilabel Classification (Resubmission)∗
Multilabel classification is an extension of conventional classification in which a single instance can be associated with multiple labels. Recent research has shown that, just like for standard classification, instance-based learning algorithms relying on the nearest neighbor estimation principle can be used quite successfully in this context. However, since hitherto existing algorithms do not...
متن کاملOrdinal Regression by Extended Binary Classification
We present a reduction framework from ordinal regression to binary classification based on extended examples. The framework consists of three steps: extracting extended examples from the original examples, learning a binary classifier on the extended examples with any binary classification algorithm, and constructing a ranking rule from the binary classifier. A weighted 0/1 loss of the binary c...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2010